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Related Applications 
[01] This application claims priority in United States provisional application serial no. 
60/407,047, filed on August 29, 2002. 
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Field of the Invention 
[02] The present invention relates to a system and method for phone enabled direct 
response, and more particularly relates to a system and method for identifying a 
retransmitted acoustic transmission by comparing it with acoustic transmissions received 
15 from a secondary source. 

Background of the Invention 

[03] There are many applications that require the ability to identify the specific media 
and/or its source that is being broadcast or is playing at a consumer's immediate point-of- 
20 presence (POP), such as a home or office, car, store, stadium, theater and so on. 
Examples of such applications include direct-response advertisements, promotions, fiind- 
raising campaigns, interactive entertainment, information and public services. The 
attractiveness of these applications to consumers and businesses is directly related to the 
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ease and speed with which the media and/or its source can be identified and the consumer 
is connected to an appropriate entity (advertiser, broadcaster, media company etc.). 
[04] Because of its ubiquity, famiUarity and ease of use the phone is a natural vehicle 
for enabling such activities. By "listening" through the consumer's phone it is possible to 

5 identify the media playing at the POP and take appropriate action. Existing telephonic 
techniques for identifying media at the POP have required either direct user input, 
decoding embedded 'marks' in the media or matching the media's acoustic signature with 
previously stored signatures. In practice these techniques have proven to be too complex 
or too slow to gain acceptance. The problem is largely due the adverse impact of the 

10 phone and phone network on the quality of the signal retransmitted from the POP to the 
appropriate processing authority. 



Summary of the Invention 
[05] The present invention provides a method and system that circumvents the adverse 

15 effects of phones and telecommunications networks on works and acoustic marks 
encoded within acoustic transmissions retransmitted through phones. A method is 
provided for identifying the retransmitted acoustic transmission by matching it to the 
same, but "clean", transmission received over a second path. Acoustic marks encoded in 
the acoustic transmission received over the second path may also be associated with the 

20 retransmitted acoustic transmission. 

[06] Accordingly, one embodiment of the invention is a method wherein a first 
acoustic transmission is received from a phone, a secondary acoustic transmission is 
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received over a secondary path, and the first acoustic transmission is matched to the 
second acoustic transmission. 

[07] Another embodiment of the invention is a method wherein an audible acoustic 
transmission is received over a first path, and the same acoustic transmission is received 

5 over a second path. An acoustic mark encoded in the transmission received over the 
second path is associated with the acoustic transmission received over the first path. 
[08] In another embodiment of the invention, an audible acoustic transmission is 
received by retransmission firom a user's telephone and compared with audible acoustic 
transmissions received over a second path. The retransmitted audible acoustic 

10 transmission is matched with one of the audible acoustic transmissions received over the 
second path, and a transaction is initiated based on the match. 

[09] Another embodiment of the invention is identifying a retransmitted acoustic 
transmission by comparing it with acoustic transmissions received from a secondary 
source. 

15 [10] Other systems, methods, features and advantages of the invention will be or will 
become apparent to one with skill in the art upon examination of the following figures 
and detailed description. It is intended that all such additional systems, methods, features 
and advantages be included within this description, be within the scope of the invention, 
and be protected by the accompanying claims. 

20 
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Brief Description of the Drawings 

[11] The components in the figures are not necessarily to scale, emphasis instead being 

placed upon illustrating the principles of the invention. In the figures, like reference 

numerals designate corresponding parts throughout the different views. 

[ 1 2] FIG. 1 is a block diagram of a system according to the present invention. 

[13] FIG. 2 is a block diagram illustrating an acoustic transmission with encoded 

marks according to the present invention. 

[14] FIG. 3 is a block diagram of an example implementation of the present invention. 



Detailed Description 

[15] A system 10 according to the present invention is illustrated in FIG. 1. System 10 
circumvents the adverse effects of phones and telecommunications networks on works 
and inaudible acoustic marks encoded within acoustic transmissions retransmitted 
through phones. An acoustic transmission that is retransmitted by the user's phone is 
identified by comparing it with acoustic transmissions received via a secondary path. 
Acoustic marks encoded in the acoustic transmissions received over the secondary path 
are associated with the same acoustic transmission received via retransmission by a user's 
phone. 

[16] An original acoustic transmission 12 is generated from any number of sources 
including, for example, radio and television broadcasts, public address systems and media 
players for media such as CDs, DVDs, video and audio tapes. Acoustic transmission 12 
includes a work 14 and an acoustic mark 16. Mark 16 is typically inaudible, wherein the 
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term "inaudible" refers to near-inaudible as well as inaudible signals. Under some 
circumstances, however, mark 16 might be audible. An example of an audible mark is an 
emergency broadcast tone or aimouncement. Mark 16 may be related or unrelated to 
work 14. Mark 16 may be, for example, a watermark that is specific to work 14 and 
5 remains with work 14 for its lifetime. Examples of works that may contain such marks 
include music, advertisements, news stories/features, announcements, television 
programs, movies, etc. 

[17] As depicted in FIG. 2, a mark may be encoded within a specific work (i.e. a 
particular advertisement or song) and/or within an acoustic transmission containing 

10 multiple works (i.e. a radio or television broadcast, or a CD or DVD containing numerous 
works). Acoustic transmission 60 of FIG. 2 contains multiple works, each of which may 
or may not have its own mark: advertisement 62 is encoded with mark 64; song 66 is 
encoded with a mark 68; song 70 has no mark; and advertisement 72 is encoded with 
mark 74. The individual marks associated with the individual works may be encoded, for 

15 example, during the production of the work (e.g. post production or optical media 
mastering/replication). Additionally (or alternatively), transmission 60 includes a mark 
76 encoded directly into the broadcast stream and spanning all of the individual works. 
As depicted, mark 76 is typically a repeating/continuous mark (such as a station ID) 
encoded directly into the broadcast stream at the station, uplink, cable head-end or other 

20 location. 

[18] Referring again to FIG. 1, original acoustic transmission 12 is transmitted over 
separate paths 18 and 24 to a transaction server or Network Operation Center (NOC) 30. 
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Path 18 comprises retransmission by a user's phone 20 of original acoustic transmission 
12 over a communications network 22 to NOC 30. The term "phone" is intended broadly 
and refers to any device capable of receiving audio and communicating over a 
telecommunications network. Examples include cellular phones, portable phones, plain 

5 old telephone systems (POTS), personal digital assistants (PDAs) enhanced with telecom 
or wireless LAN connections such as 802. llx and Bluetooth, and so on. Additionally, 
while the methods herein are described as occurring in a single facility (the "NOC"), it 
should be understood that the method and system components may be integrated or 
distributed amongst various equipment configurations and locations. 

10 [19] In one implementation, while acoustic transmission 12 is being transmitted within 
his hearing by, for example, a speaker 17, the user calls NOC 30 using phone 20. 
Acoustic transmission 12 may be, for example, a radio or television broadcast that is 
picked up by the microphone of phone 20 and retransmitted to NOC 30 when the user 
calls NOC 30. The user's voice and other ambient noise in the user's presence will also 

15 be transmitted along path 18 to NOC 30. 

[20] Hence, NOC 30 receives a first acoustic transmission 32 via path 18 comprising 
original acoustic transmission 12 as retransmitted by phone 20, along with the user's 
voice and other ambient noise. NOC 30 may receive transmission 32 by any of the well 
known ways of answering a voice call. Phone 20 may retransmit acoustic transmission 

20 14 in the same way it transmits a voice call, or it may pre-process acoustic transmission 
14 and then transmit a processed variant to NOC 40. In the latter scenario, NOC 40 may 
handle acoustic transmission 32 as either a voice call or a data communication. 
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[21] First acoustic transmission 32 comprises work 34 and acoustic mark 36 
(retransmitted versions of work 14 and mark 16). As shown in FIG. 1, mark 36 may be 
of degraded or lower quality due to signal degradation, ambient noise, etc. that occurs 
during retransmission over path 18. 

5 [22] Original acoustic transmission 12 is also transmitted to NOC 30 via a secondary 
communication path 24. Path 24 may comprise, without limitation, an over-the-air radio 
or TV terrestrial broadcast, cable or satellite, Internet, Tl and frame relay. Hence, NOC 
30 receives a second acoustic transmission 40 comprising original acoustic transmission 
12 as transmitted over secondary path 24. Acoustic transmission 40 from secondary path 

10 24 is received simultaneously, near simultaneously or temporally offset (before or after) 
with acoustic transmission 32 from path 18. 

[23] Second acoustic transmission 38 comprises work 40 and acoustic mark 42 
(directly transmitted versions of work 14 and mark 16). Since it is directly transmitted, 
mark 42 is "clean" and is typically of much higher quahty than the mark 36 received by 
15 retransmission. 

[24] NOC 30 correlates or matches (line 46) the work portion 34 of acoustic 
transmission 32 received from phone 20 with the work portion 40 of acoustic 
transmission 38 received via secondary path 24. This matching or correlation process 46 
may use well-known processes such as time-frequency correlation or feature matching, 
20 and may be performed in software or hardware. Acoustic transmission 38 may be filtered 
through a phone or other hardware or software filter (i.e. a vocoder emulator) as part of 
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the process. In one embodiment, match 46 is a "simple match" between acoustic 
transmission 32 from phone 20 and acoustic transmission 38 from secondary path 24, 
[25] In another embodiment, match 46 is a "best match" between acoustic transmission 
32 received from phone 20 and multiple and different acoustic transmissions 38 received 

5 via secondary paths 24. NOC 30, for example, may receive multiple acoustic 
transmissions 38 from all radio stations playing within the user's area. When a 
transmission 32 is received that comprises a radio station playing within the user's 
listening range and retransmitted by phone 20 to NOC 30, transmission 32 is correlated to 
the "best match" among all transmitting radio stations (as embodied in transmissions 38). 

10 [26] In certain instances, the number of different acoustic transmissions 38 being 
matched to transmission 32 from phone 20 may be minimized. Information about the 
user's location and the corresponding acoustic transmissions originating in that area, for 
example, may be used to reduce the number of potentially matching transmissions. 
Information about the user's location may be derived from, for example, GPS 

15 coordinates, E91 1 data, caller ID data, cell sites and previously stored user profiles. The 
phone number used to call NOC 30 may also be used to minimize the number of potential 
matching acoustic transmissions 38. Particular call-in numbers, for example, may be 
associated with particular locations or particular transmission types or sources (e.g., radio 
broadcasts, sports broadcasts, television broadcasts). 

20 [27] Although mark 36 received by retransmission over path 18 is typically damaged 
or degraded relative to mark 42 received over secondary path 24, it will still likely 
embody information that may be of use in the matching process. Hence, a useable 
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portion of mark 36 in combination with work 34 may be used to find a match with a mark 
and work received over the "clean" path 24. 

[28] Once a match 46 has been obtained, any marks 42 that are encoded within the 
matching transmission 38 are decoded to produce a decoded mark 44 that is associated 
(Une 48) with the acoustic transmission 32 received from the user's phone. The marks 
encoded within acoustic transmissions received over direct path 24 are "clean" and not 
adversely affected, as may be marks encoded within acoustic transmissions received over 
retransmission path 18. This decoding process may use any of the well-estabhshed 
techniques consistent with the method of encoding the marks within the acoustic 
transmission. Association 48 may be executed as a real-time transaction or in a database. 
Association 48 may be extended to include dependent links 50 to information such as the 
user's phone number (caller ID), a previously stored profile (personal information and 
preferences), user inputs (e.g. personal identification number, promotion code, etc.) via 
the user's phone (keypad, touch screen, stylus, voice recognition, etc.), other marks, the 
acoustic transmission and its source. Association 48 may be used to trigger a variety of 
transactions such as, for example, sending a voice response to the user, or sending an 
email to the user using previously stored personal information linked to the caller ID. 
Other transactions that might be triggered include posting a link or other information to a 
website, or routing the call to a third party. 

[29] Any or all of the acoustic transmissions received by NOC 30, processed 
transmissions and decoded marks may be stored in memory at NOC 30 and processed at 
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different times. Hence, the matching and association processes 46 and 48 may be 
initiated and/or completed some time after the user has terminated the call. 
[30] Example 1 

[31] One application of the present invention is shown in FIG. 3. An advertisement 
5 containing an inaudible mark is broadcast by a local radio station 80. The mark contains 
a unique number or ED that identifies that specific advertisement. A NOC 82 has radio 
tuners 84 tuned to each of the twenty radio stations broadcasting in a user's general 
vicinity. While listening to his car radio 86, the user calls NOC 82 using his cell phone 
88. NOC 82 signal processes the acoustic transmission from the user's car radio 86 that 

10 is being retransmitted by the user's phone 88 over path 89. 

[32] Concurrently, NOC 82 receives each of the twenty available radio broadcasts via 
over-the-air paths 90 and decodes the inaudible marks encoded within those broadcasts. 
Because these acoustic transmissions are not retransmitted by phones, the marks encoded 
within those transmissions are not adversely affected by the phone (vocoder) or the phone 

15 network. NOC 82 compares the acoustic transmission (the audio advertisement) 
retransmitted by phone 88 over path 89 to the twenty other radio broadcasts (with the 
encoded marks unaffected) it receives via over-the-air paths 90 and performs a "best 
match". When a best match is found, NOC 82 associates the ID (decoded mark) from the 
matched over-the-air broadcast with the acoustic transmission received from the user's 

20 phone 88. 

[33] After match and mark association is complete, NOC 82 executes a transaction in 
accordance with previously stored decision rules. For example, NOC 82 may play a 

10 
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specific message to users who call during, or within five minutes of, the advertisement. 
Hence, in short, a user calls the NOC while hstening to an advertisement or promotion on 
the radio. The NOC determines which station the user is listening to and uses the ID 
associated with that station near the time of the user's call and a previously stored 
5 decision rule to select and play the appropriate recorded voice message to the user. 
[34] Example 2 

[35] A user is watching a documentary on cable TV in his living room. He calls the 
NOC with his portable phone and is identified by caller ID and a previously stored 
profile. The audio track firom the television broadcast (documentary) is retransmitted by 

10 the user's phone to the NOC. The NOC correlates it to one of 200 channels available in 
the user's area, as determined by the area code in the user's caller ID. Alternatively, the 
channels available in the user's area might be determined by referencing a previously 
registered user profile indicating the user's cable provider. The documentary has 
recurring marks encoded throughout the show that identify each segment (see, e.g., FIG. 

15 2). In response to a voice menu provided by the NOC, the user selects a "bookmark" 
option by pressing 1 on his keypad. The NOC automatically sends an email containing 
additional programming and promotions directly to the user's email address as contained 
in the user's profile. Different emails may be sent depending on which segment was on 
air when the user called (as determined by the matching and association process). 

20 [36] While various embodiments of the invention have been described, it will be 
apparent to those of ordinary skill in the art that many more embodiments and 
implementations are possible that are within the scope of this invention. 
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